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ON  FIXED-INTERVAL  MINIMUM  SYMBOL  ERROR  PROBABILITY  DETECTION 


Consider  a  data  communications  model  in  which  the  observed  process  is 

r ( t )  =  S(t,b)  +  n(t)  -MT  <  t  <  (M+2)T  (1) 

where  n(t)  is  zero-mean  white  Gaussian  noise  (spectral  height  of  N^/2) ,  T  is 
the  symbol  interval  duration  and  S(t,b)  is  a  linearly  modulated  K-user 
information-bearing  signal  which  can  be  expressed  as 


M  K 

S(t,b)  =  Y.  Z  bk(i)  sk(t  -  iT  -  rt)  (2) 

i=-M  k=l  *  *  x 

where 


b  =  tb(  i)  =  [b2(i),  ....  bK(i)]T.  i  =  -M,  — ,  M} ; 

> 

and  b^(  i)  £  A,  s^(t)  (assumed  to  be  zero  outside  a  finite  interval  of  positive 
real  line)  and  £  [0,T)  are  the  i**1  bit,  the  signal  waveform  and  the  delay 
(modulo  T  with  respect  to  an  arbitrary  reference)  respectively  of  the 
user.  It  is  easy  to  see  that  the  usual  models  for  asynchronous  multiple- 
access  communications  [1]  and  for  PAM  subject  to  finite-length  intersymbol 
interference  [2]  are  encompassed  by  the  above  model. 

In  this  report,  we  present  a  forward-backward  algorithm  that  offers  MAP 
symbol-by-symbol  detection  upon  observation  of  the  whole  received  process, 
i . e . ,  it  solves  for 


a  |  r ( t) ,  -MT  £  t  <  (M+2)T]  (3) 

It*  1  #  •  •  •  $  R 
i  *  -M . M. 

or  equivalently 


t>k(i)  e  arg  max  P[b.(i)  = 
a€A 


2 


bk(i)  €  arg  max  E  exp[  fT”  0(b)] 

a€A  b  o 


where 


s*t.  t>a(i)=a 


M  MM 

Q(b)  =  2  I  bT(i)y(i)-I  I  bT(i)H(i-j)b(j)  . 

i=-M  i=-M  j  =-M 


and  y(i)  =  [ ( i) ,  y^( i)]T  is  the  set  of  outputs  of  the  K  matched  filters 

corresponding  to  the  it41  symbol .  i.e.. 


vck+( i+l)T 

c(i)  -  J  r(t)  sk(t  -  iT  -  tk)  dt. 


*k+iT 


and  the  K  x  K  correlation  matrices  H(i)  are  defined  by 


T 

Bfcjd)  ■  |  sk(t)  Sj(t  +  iT  +  tk  -  Tj)  dt. 


Because  of  the  assumed  finite  length  of  the  signals  sk(t),  there  exists  an 
integer  m  such  that 

H(i)  -  0  for  lil  >  m.  (8) 

The  set  S  «  will  be  referred  to  as  the  state-space,  and  the  subsets 

of  admissible  preceding  and  next  states  for  a  given  a  €  S  are  denoted  by* 


P(a)  **  lx  €  S,  s  •  t ,  x4+1  *=  a4,  i  *=  1 ,  m-1) 


N(a)  *  (x  €  S,  s « t  •  x4  -  <ri+1,  i  «  1.  m-1) 
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If  a  €  S  and  z  €  A^  then  define  the  scalar. 


V(o,z)  =  exp[-rf-  zT(H(0)z  +  21  H(m  -  j  +  l)<rb]. 
0  j=l 


Equipped  with  the  above  definitions,  we  can  state  onr  solution  to  (4): 


Algorithm 

arg  max  I  exp[  jj-  Q(b)]  = 

a€A  b  0 

s.t.  bk(i)=a 

arg  max  I  Fi(c)  B^o)  (9) 

a€A  ct€S 

s.t.  cr^=a 


where  Fk(>)  and  Bk(>)  are  defined  through  the  forward  and  backward  recursions: 


Bv(o)  =  exp[  ?r-y^(k)am]  £  Fk_.(x)  V(x,am)  (10) 

*  N0  x€P(o)  *  1 


Bv_i(a)  *  £  B^x)  Vto.x1”)  exp!  tf-yT(k)xm]  (11) 

x€N(o)  *  0 


and  the  initial  conditions: 


F.  (o)  =  exp[w-(2  £  y^(i)o^  -  Z  Z  <j^H(  i-j)ffj ] ,  k  i  m  (12a) 

0  i=m-k+l  i=m-k+l  j=m-k+l 


BM  =  1  • 


(12b) 


Proof 


First,  organizing  the  terms  in  the  sum  of  (4),  we  have  that 


£  exp[  if-  Q(i)  ] 
i  N0 

s.t.  bk(i)-a 
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£  T.  exp[  jJ-  0(b)  ]  , 

a€S  k€W-M,M(a>i)  0 

<Tv=a 


where  we  have  used  the  notation 


(13) 


Wi,J(<y,k)  =  { {b{  i)  ,  b  ( j ) )  s.t.  b(n)  €  AK  for  n  =  i,...,j 

and  [b(k-m+l)  ...  b(k)]  =  a). 


i.e.,  the  set  of  all  symbol  subsequences,  whose  components  k-m+1,  k  coin¬ 

cide  with  a  given  state  a  £  S, 

Using  the  fact  that  H(i)  =  H^(-i)  (see  (7)),  it  is  straightforward  to 
check  that 


M  M  x  M  _  i-1 

I  I  bT(i)  fl(i-j)  b(j)  =  1  hT(i)mO)  b(i)  +  2  Z  H(i-j)  b(j)], 
i=-M  j=-M  i=-M  j=~M 


hence  we  have 


£  exp[  tj-  Q(b)] 

w0 


b€W~M'M(<r,i) 


b€W-M,M{ o, i) 


2  M 
«xp[  jj-  I 

0  k=-M 


I 

W-1*'  i(o,  i) 


exp[  t=-  I 
0  k— M 


Wi+1,M(C>1) 


eXP[N  1 
N0k-i+l 


bT(k)(y(k)  -  j  H(0)b(k)  + 
bT(k)(y(k)  -  ~  H(0)b(k)  + 

bT(k)(y(k)  -  ~  H(0)b(k)  + 


k-1 

I 

j=-M 


k-1 

I 

j-M 


k-1 

I 

j— M 


H(k-j)  b( j) )  ] 


H(k-j)  b( j) ) ]  * 


B(k-j)  b( j ) ) ]  (14) 


where  the  last  equality  follows  from  property  (8).  It  remains  to  show  that 
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both  terms  in  the  right  hand  side  of  (14)  correspond  to  ¥^(0)  and  Bi(o) 
respectively,  as  defined  by  (10)  -  (12),  To  that  end,  we  can  write 

7  ^  T  1  h— 1 

11  t  exp[  f-  I  t>  UO  (y(k)  -jH(0)b(i)  +  I  H(k-j)  b(j))]  - 

N0  k*-M  1  j=— M 

£  I  exp^  N”  *mT(y(i)  "  T  H(0)  ff“  +  I  H(n-j+l)x^)]  • 

x€P(c)  W”M, i“l(Xf i-i)  0  j=1 

2  i-l  T  ,  k-1 

exptjj-  I  bA(k)(y(k)  -  i  H(0)b(k)  +  I  H(k-j)b(j))] 

0  k=-M  j=— M 

and  the  recursive  expression  (10)  follows  (for  m  <  k) . 


Analogously, 


.  M  51  e*pt  jl-  Z  bT(k)(y(k)  -  |  l(0)b(k)  +  Z  H(k-j)b(j))] 
W1'M(o.i-l)  0  k=i  2  j=-M 


=  1  .  -  u  E  exp[N~  x“(y<i)  "  5  H(0)  x“  +  I  H(m-j+l)<jj)]  • 

x6N( o)  W1+1'M(x,i)  0  2  j=l 

2  M  T  1  k-1 

expl  j|-  Z  b1(k)(y(k)  -  \  H(0)b(k)  +  Z  H(k-j)b(j) ) ]  . 

0  k=i+l  2  j=-M 

Hence,  coopering  with  (11)  and  (12b)  we  can  identify 

2  M  ~  ,  k-1 

I  expt  i£-  Z  bT(k)  (y(k)  -  4  H(0)b(k)  +  Z  H(k- 

N0  k=i+l  2  j«-M 


B^o) 


j)b(j))] 


Wi+1'M(o,i) 


and  the  claim  is  proved. 

The  forward-backward  structure  of  the  above  fixed-interval  symbol-by- 
syobol  optimum  detection  algorithm  resembles  the  well-known  solution  for 
fixed-interval  smoothing  (e,g.  [3]),  the  main  difference  being  the  indepen¬ 
dence  of  the  forward  and  backward  recursions.  In  fact,  the  existence  of  such 
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algorithms  for  Markovian  decision  problems  can  be  traced  back  to  the  work  by 
Chang  and  Hancock  [4],  and  is  concisely  explained  in  Forney  [5,  App.];  see 
also  [6]  for  a  recent  application  of  this  idea. 

Of  particular  interest  here  is  the  work  by  Hayes  e_t  al..  [7]  ,  in  which 
they  propose  an  algorithm  for  solving  the  minimum  symbol  error  probability 
problem  for  our  same  model  (in  the  special  case  of  1  user).  In  this  algo-* 
rithm,  the  likelihood  of  every  possible  value  of  each  symbol  is  computed  by 
deleting  all  the  trellis  states  that  are  not  congruent  with  such  value  and 
then  running  a  forward  recursion  similar  to  (10).  Noticing  that  at  every  step 
the  recursion  is  common  for  future  symbols,  the  number  of  computations  can  be 
halved,  A  comparison  between  the  computational  complexities  of  the  algorithm 
by  Hayes  et  aK  and  the  one  proposed  here  seems  in  order. 

2  T  r 

The  quantities  exp[  rpy  (k)  *z]  ,  and  V(a,z)  with  a  €  S  and  z  €  A  ,  are 

N0 

common  to  both  algorithms;  the  fiist  can  be  computed  efficiently  digitally  or 
analogically  for  every  input  vector  and  for  every  symbol  combination  and  the 
set  of  second  quantities  can  be  precomputed  and  stored  since  it  does  not 
depend  on  the  data.  In  any  case,  the  time  and  space  costs  incurred  in  the 
above  computations  should  be  added  to  those  that  follow. 

Employing  the  notation,  L  ®  |A|K,  every  step  of  the  forward  and  backward 
recursions  entails  per  state:  L  +  1  and  2L  multiplications,  respectively,  and 
L  -  1  additions,  i.e.,  (3L  +  l)Lm  multiplications  and  (2L  -  2)Lm  additions. 
The  final  product  of  the  forward  and  backward  quantities  requires  one  multi¬ 
plication  per  state,  i.e.,  Lm  multiplications  per  step,  and  the  computation  of 
the  likelihood  for  each  symbol  value  requires  Lm/ I A I  -  1  additions,  i.e.,  Lm  - 
I A I  per  step. 
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If  the  algorithm  by  Hayes  et.  al,.  is  implemented  with  a  fixed  delay  of 
M 2 ,  then  every  step  of  the  recursion  therein  is  analogous  to  our  forward 
recursion  and  requires  L  -  1  additions  and  L  +  1  multiplications,  per  state. 
However,  the  state  trellis  is  different  for  each  symbol,  and  the  number  of 
additions  and  multiplications  per  state  must  be  multiplied  by  (1  +  M^L) . 
Finally,  every  possible  symbol  value  requires  Lm  -  1  additions  in  order  to 
obtain  its  likelihood.  ([7,  step  3,  p.  155]).  The  final  step  of  both  algo¬ 
rithms  is  to  choose  the  largest  of  f  A I  quantities  per  symbol. 

Regarding  global  storage  requirements,  our  algorithm  needs  to  store  the 
entire  sequences  of  values  of  F ^(o)  and/or  B^Ccr),  i.e.,  2MLm  quantities.  On 
the  other  hand,  the  algorithm  in  [7]  requires  the  storage  of  Lm(l  +  M^L) 
values.  Summarizing,  both  algorithms  have  the  following  complexities: 


HAYES  et  al. 


FORWARD- BACKWARD 


i 

i 

l 


ADDITIONS 

Lm+1(M2L  -  m2  +  1)  -  1 

Lm(2L  -  1)  -  |Al 

(per  symbol) 

MULTIPLICATIONS 

(per  symbol) 

Lm(l  +  M2l)(L  +  1) 

LB(3L  +  2) 

STORAGE  L"(l  +  M^L)  l“(2M) 
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The  key  parameter  in  the  comparison  of  both  algorithms  is  L;  if  L  is 
large  (as  is  the  case  in  multi-access  communications  with  more  than  3  or  4 
users)  then  the  forward-backward  algorithm  offers  computational  savings  of  the 
order  of  if  L  is  small  (e.g.,  binary  single-user  communicat ions)  then  the 
computational  effort  of  the  algorithm  in  [7]  is  roughly  that  of  the  forward- 
backward  algorithm  times  .  Note  incidentally  that  since  the  forward  and 
backward  recursions  are  independent,  there  exists,  obviously,  the  possibility 
of  implementing  them  in  parallel. 

With  respect  to  the  storage  requirements,  the  comparison  depends  on  the 
relative  values  of  the  fixed  delay  M2  and  M,  the  fixed  length  of  the  data 
record  processed  in  batch.  In  general,  the  choice  of  M  for  the  fixed  interval 
algorithm  will  be  dictated  by  the  storage  capabilities,  the  allowable  decision 
delay,  and  the  performance  degradation  due  to  the  partitioning  of  the  data 
record.  It  is  not  unreasonable  to  expect  that  comparable  levels  of  degrada¬ 
tion  will  be  attained  by  algorithms  whose  respective  fixed  delay  and  (half 
of)  fixed  length  M  coincide.  Notice  that  minimum  symbol  error  probability 
detection  can  only  be  justified  as  an  alternative  to  optimum  sequence  detec¬ 
tion  (via  Viterbi  algorithm)  in  low  signal-to-noise  ratio  situations  since 
otherwise  the  optimum  decisions  according  to  both  criteria  do  not  differ 
appreciably.  The  relevance  of  this  point  stems  from  the  fact  that  the  delay 
or  data  record  length  required  for  achieving  a  given  degree  of  performance 
degradation  increase  as  the  signal-to-noise  ratio  decreases. 
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